Lessons learned and new strategies for success: Evaluating the Implementation of Competency-Based Medical Education in Queen's Pediatrics.

Objectives: In 2017, Queen's University launched Competency-Based Medical Education (CBME) across 29 programs simultaneously. Two years post-implementation, we asked key stakeholders (faculty, residents, and program leaders) within the Pediatrics program for their perspectives on and experiences with CBME so far. Methods: Program leadership explicitly described the intended outcomes of implementing CBME. Focus groups and interviews were conducted with all stakeholders to describe the enacted implementation. The intended versus enacted implementations were compared to provide insight into needed adaptations for program improvement. Results: Overall, stakeholders saw value in the concept of CBME. Residents felt they received more specific feedback and monthly Competence Committee (CC) meetings and Academic Advisors were helpful. Conversely, all stakeholders noted the increased expectations had led to a feeling of assessment fatigue. Faculty noted that direct observation and not knowing a resident's previous performance information was challenging. Residents wanted to see faculty initiate assessments and improved transparency around progress and promotion decisions. Discussion: The results provided insight into how well the intended outcomes had been achieved as well as areas for improvement. Proposed adaptations included a need for increased direct observation and exploration of faculty accessing residents' previous performance information. Education was provided on the performance expectations of residents and how progress and promotion decisions are made. As well, "flex blocks" were created to help residents customize their training experience to meet their learning needs. The results of this study can be used to inform and guide implementation and adaptations in other programs and institutions.

Dedicated Assessors: description of an innovative education intervention to facilitate direct observation in the clinical setting.

BACKGROUND: The Department of Pediatrics at Queen's University undertook a pilot project in July 2017 to increase the frequency of direct observations (DO) its residents received without affecting the patient flow in a busy hospital-based pediatric ambulatory care clinic. Facilitating DO for authentic workplace-based assessments is essential for assessing resident's core competencies. The purpose of this study was to pilot an innovative education intervention to address the challenge of implementing DO in the clinical setting. METHODS: The project allowed for staff physicians to act as "dedicated assessors" (DA), a faculty member who was scheduled to conduct direct observations of trainees' clinical skills, while not acting as the attending physician on duty. At the end of the project, focus group interviews were conducted with faculty and residents, and thematic analysis was completed. RESULTS: Participants reported an increase in the overall quality of feedback received during the observations performed by a DA, with more specific feedback and a broader focus of assessment. There seemed to be little disruption to patient care. Some residents described the observations as anxiety-provoking. CONCLUSIONS: Overall, this project provides insight into an educational approach that medical residency programs can apply to increase the frequency of workplace-based DO and boost the quality of feedback residents receive while maintaining the flow of already busy ambulatory care clinics.

CONTEXTE: En juillet 2017, le département de pédiatrie de l'Université Queen's a lancé un projet pilote visant à augmenter la fréquence des observations directes (OD) dont faisaient l'objet ses résidents sans affecter le flux de patients dans une clinique achalandée de soins pédiatriques ambulatoires. Il est essentiel de faciliter l'OD, permettant une évaluation authentique en milieu de travail, afin d'évaluer les compétences fondamentales des résidents. L'objectif de cette étude était de piloter une intervention éducative novatrice pour relever le défi de la mise en place de l'OD dans le cadre clinique. MÉTHODES: Le projet permettait aux médecins d'agir en tant qu'« évaluateurs attitrés ¼ (ÉA) : c'est-à-dire un membre du corps professoral chargé de l'observation directe des compétences cliniques des apprenants alors qu'il n'était pas le médecin traitant de service. Une analyse thématique a été réalisée sur la base d'entrevues de groupe menées avec le corps professoral et les résidents à la fin du projet. RÉSULTATS: Les participants ont signalé une augmentation de la qualité générale de la rétroaction reçue au cours des observations effectuées par un ÉA, notamment des commentaires plus précis et une évaluation plus complète. Il semble y avoir eu peu de perturbations dans les soins aux patients. Certains résidents ont décrit les observations comme étant anxiogènes. CONCLUSIONS: Dans l'ensemble, ce projet donne un aperçu d'une approche éducative qui peut être appliquée dans le cadre des programmes de résidence en médecine dans le but d'augmenter la fréquence des OD en milieu de travail et d'améliorer la qualité de la rétroaction reçue par les résidents sans perturber le flux de patients dans les cliniques de soins ambulatoires déjà très achalandées.

Competence committee: How meeting frequency impacts committee function and learner-centered assessment.

The Department of Pediatrics at Queen's University wrestled with following the RCPSC guidelines with regards to Competence Committee (CC) meeting frequency, this article outlines adaptations we made to CC function and the rationale for our design decisions. After adopting a monthly meeting approach that focuses on formative assessment and greater resident feedback we have created an enhanced learner-centered assessment process that more fully empowers our residents with timely formative feedback to better support them in actively taking ownership of and responsibility for their learning.